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Abstract 



u 

:^ 

d 

. ,— ( ' We study the effect of competition between short-term synaptic de- 

1.^ , pression and facihtation on the dynamical properties of attractor neural 

^^' networks, using Monte Carlo simulation and a mean field analysis. De- 

pending on the balance between depression, facilitation and the noise, the 
network displays different behaviours, including associative memory and 
switching of the activity between different attractors. We conclude that 
synaptic facilitation enhances the attractor instability in a way that (i) 
intensifies the system adaptability to external stimuli, which is in agree- 
ment with experiments, and (ii) favours the retrieval of information with 
^!^ , less error during short-time intervals. 

o 

O ■ 1 Introduction and model 

. ^ I Recurrent neural net"works are a prominent mode l for i nformation processing 

T^ • and memory in the brain. (jHonfieldl . Il982t lAmiii . Il98fll) . Traditionally, these 

^h| models assume synapses that may change on the time scale of learning, but 

r* ■ that can be assumed constant during memory retrieval. Ho'wever, synapses are 

.J^ I reported to exhibit rapid time variations, and it is likely that this finding has 

j^ ■ important implicati ons for our under standing of the ■way information is pro- 

H I cessed in the brain (jAbbott and R.egehr, .20041 . For instance, Hopfield-like net- 

■works in ■which synapses undergo rather generic fluctu ations have been sh o^wn 
to significantly improve the associative process, e.g., IjMarro et al.l Il998(l . In 
addition, motivate d by specific neurobio logical observations and their theoret- 
ical interpretation (jTsodvks et allll998l) . activity-dependent syn aptic changes 
■which ind uce depression of t he response have been considered l|Pantic et al.L 
12002 : Bibitchkov et al.L 120021) . It ■was sho^wn that synaptic depression induces, 
in addition to memories as stable attractors, special sensitivity of the net^work to 
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chanK ing stimuli as well a s rapid switching of the activity among the stored pat- 
terns llPantic et all l200^ ICortes et all l20o3 iMarro et all l2005t iTorres et all 
l2005t ICortes et all l2006|) . This behaviour has been obs erved experini e ntally 
to occur during the processing of sensory i nformation l|Laiirent et all l200lt 
iMazor and LaurentL IJOO^t iMarro et"an.l200(il) . 

In this paper, we present and study networks that are inspired in the ob- 
servation of certain, more complex synaptic changes. That is, we assume that 
repeated presynaptic activation induces at shor t times not only depression but 
also facilitation of the postsynaptic potential llThomson and DeucharsL Il994l 
IZucker and Regehn . I2OO2I: iBurnashev and Rozovi |20^. The question, which 
has not been quite addressed yet, is how a competition between depression and 
facilitation will affect the n etwork per formance . We here conclude that, as for 
the case of only depression ijPantic et al., 2002t lCortes et alll2006|) . the system 
may exhibit up to three different phases or regimes, namely, one with standard 
associative memory, a disordered phase in which the network lacks this property, 
and an oscillatory phase in which activity switches between different memories. 
Depending on the balance between facilitation and depression, novel intriguing 
behavior results in the oscillatory regime. In particular, as the degree of facil- 
itation increases, both the sensitivity to external stimuli is enhanced and the 
frequency of the oscillations increases. It then follows that facilitation allows for 
recovering of information with less error, at least during a short interval of time 
and can therefore play an important role in short-term memory processes. We 
are concerned in this paper with a network of binary neurons. Previous studies 
have shown that the behaviour of such a simple network dynamics agree quali- 
tatively with the behaviour that is observed in more realistic networks, such as 
integrate and fire neuron models of pyramidal cells l|Pantic et all 120021) . 

Let us consider N binary neurons, Si — {1,0}, i = 1,...,A^, endowed of a 
probabilistic dynamics, namely, 

Prob {s, (i + 1) = 1} = i {1 + tanh [2l3h, (t)]} , (1) 

which is controlled by a te mperature parameter, T = 1//3; see, for instance, 
I Marro and DickmanL 12005(1 for details. The function hi{t) denotes a time- 



dependent local field, i.e., the total presynaptic current arriving to the post- 
synaptic neuron i. This will be determined in the model fol lowing the phe- 
nomcnological description of nonlinear synapses reported in IjMarkram et all 
|l998; Tsodyks et all Il998l) . which was shown to capture well the experimen- 
tally observed properties of neocortical connections. Accordingly, we assume 
that 

N 

h, (i) = ^ Lj.jVj (t) Tj it) sj it) - e„ (2) 

where 9i is a constant threshold associated to the firing of neuron i, and 'Djit) 
and Tj{t) are functions — to be determined — which describe the effect on the 
neuron activity of short-term synaptic depression and facilitation, respectively. 
We further assume that the weight w^ of the connection between the (presy- 
naptic) neuron j and the (postsynaptic) neuron i are static and store a set of 



patterns of the network activity, namely, the famihar covariance rule 

p 



LUi 



A./(L/) E(er-/)fe--/)- (3) 



Here, ^^ = {^f}, with i/ = l...,P, are different binary-patterns of average 
activity (^f ) = /. The standard Hopfield model is recovered for Tj — T>j ~ 1, 
Vj = l,...,7V. 

We next implement a dynamics for J-i and Vj after the prescription in 
l|Markram et allll998HTsodvks et all 119981) . A description of varying synapses 
requires, at least, three local variables, say Xj (i), yj (t) and Zj (t) , to be asso- 
ciated to the fractions of neurotransmitters in recovered, active, and inactive 
states, respectively. A simpler picture consists in dealing with only the Xj (t) 
variable. This simplification, which seems to describe accurately both interpyra- 
midal and pyramidal interneuron synapses, corresponds to the fact that the time 
in which the postsynaptic curren t decays is much shorter than t he recovery time 
for synaptic depression, say Tree iJMarkram and Tsodvksl Il996() (Time intervals 
are in milliseconds hereafter). Within this approach, one may write that 

I — X- (t) 
X, (t + 1) = Xj (t) + 1^ - V, (t) T, (t) s, {t) , (4) 

Tree 



where 
and 



V, (t) = X, (t) (5) 

Tj{t) = U+{l-U)uj{t). (6) 

The interpretation of this ansatz is as follows. Concerning any presynaptic 
neuron j, the product 'DjJ-j stands for the total fraction of neurotransmitters 
in the recovered state which are activated either by incoming spikes, UjXj, or 
by facilitation mechanisms, (1 — C/j) xjUj; for simplicity, we are assuming that 
Uj = U € [0, 1] Vj. The additional varia ble m, (t) is assumed to satisfy, as in the 
quantal model of transmitter release in JMarkram et al.Ul998|) . that 

u, (t + 1) = u, (t) - ^^ + U[1- u, {t)] s, {t) , (7) 

which describes an increase with each presynaptic spike and a decay to the rest- 
ing value with relaxation time Tfac (that is given in milliseconds) Consequently, 
facilitation washes out [uj —^ 0, Fj — » U) as Tfac —>- 0, and each presynaptic 
spike uses a fraction U of the available resources Xj (t) . The effect of facilita- 
tion increases with decreasing U, because this will leave more neurotransmitters 
available to be activated by facilitation. Therefore, facilitation is not controlled 
only by Tfac but also by U. 

The Hopfield case with static synapses is recovered after using Xj = 1 in 
eq.Q and Uj = in eq.lO or, equivalently, t^cc = Tfac = in eqs. I@J and 
(|7|). In fact, the latter imply fields hi (t) — ^ ■ LOijUsj (t) — 9i, so that one may 
simply rescale both (3 and the threshold. 

The above interesting phenomenological description of dynamic changes has 
already been implemented in attractor neural networks llPantic e t al.[ |20 02|1 for 
pure depressing synapses between excitatory pyramidal neurons IJTsodvks and Markraml 



ll997J) . We are here interested in the consequences of a competition between 
depression and facilitation. Therefore, we shall use T, U, Tioc and Tfac in the 
following as relevant control parameters. 



2 Mean— field solution 

Let us consider the mean activities associated, respectively, with active and 
inert neurons in a given pattern v, namely. 
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It follows for the overlap of the network activity with pattern v that 
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\/i>. One may also define the averages of Xi and Ui over the sites that are active 
and inert, respectively, in a given pattern v, namely. 
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Vi^, which describe depression (the xs) and facilitation (the us) , each concerning 
a subset of neurons, e.g., N/2 neurons for / = 1/2. The local fields then ensue 
as 



/*.(*) = E(^^'^-/)^^''W 



(11) 



M^it) =[U+il-U) ul(t)] xl{t)m'^{t) -[U -{1-U) u''_{t)] x''_{t) m''_{t) . 
One may solve the model Q-Q in the thermodynamic limit iV — > oo under 
the standard mean-field assumption that Si ~ {si). Within this approximation, 
we may also substitute Xi (ui) by the mean-field values Xj_ (m^). (Notice 
that one expects, and it will be confirmed below by comparisons with direct 
simulation results, that the mean-field approximation is accurate away from 
any possible critical point.) Assuming further that patterns are random with 
mean activity / — 1/2, one obtains the set of dynamic equations: 

1 — x'^ (t) 
x^(t + 1) = <(i) + i^ -[U + {l-U) <(i) ] x^(t) m^(i), 



<(i+l) = <(t) 



«±W 



Tfa 



+ C/[l-<(i)]mi(t), 



±(*+i) = ^E|i±t^'^i^(/5 



M" (i) ± E ef^-^^ (t) 



''(^ + l) = ^E<tanh 



f3j2^^M^it) 



(12) 



where ef = 2^^* — 1. This is a 6P-dimensional coupled map whose analytical 
treatment is difficult for large P, but it may be integrated numerically, at least 
for not too large P. One may also find the fixed-point equations for the coupled 
dynamics of neurons and synapses; these are 



2m;^ = 



U Tfac m± (l + [/ Tfac m±) 



1± — "S^tanh 






Af 



N '^ 



e," tanh (3 



M 



'M^' 



(13) 



The numerical solution of these transcendental equations describes the resulting 
order as a function of the relevant parameters. Determining the stability of 
these solutions for a — P/N 7^ is a more difficult task, because it requires 
to linearize (I1 2|l and the dimensi onality diverges in the thermodynamical limit 
(see however l|Torres et all l200^ '). In the next section we therefore deal with 
the case a ^ 0. 



3 Main results 



Consider a finite number of stored patterns P, i.e., a — P/N ^ in the ther- 
modynamic limit. In practice, it is sufficient to deal with P = 1 to illustrate 
the main results (therefore, we shall suppress the index v hereafter). 



Let us define the vectors of order parameters y — {m 
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its stationary value yst that is given by the solution of Eq. 1 131 and F whose 
components are the functions on the right hand side of H12(l . The stability 
of l|12|) around the steady state l|13|) follows from the first derivative matrix 

D = (dP/dy) . This is 
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(14) 



where P = 2/3m+m_, A± = [U + {l- U) u±] x±, B± = [U +{l- U) u±] m±, 
C± = (1 - U) x±m±, D± = U{1 - M±), T = 1 - T'J, and E± = Um±. After 
noticing that m^ +to_ = 1, one may numerically diagonalize D and obtain the 
eigenvalues A„ for a given set of control parameters T, U, t^cc, '''fac- For |A„| < 1 
(|A„| > 1), the system is stable (unstable) close to the fixed point y„. The 
maximum of |A„| determines the local stability: for |A„|j^jj^ < 1, the system 
(II2II is locally stable, while for lA^lj^^g^^ > 1 there is at least one direction of 
instability, and the system consequently becomes locally unstable. Therefore, 
varying the control parameters one crosses the line lAjmax = 1 that signals the 
bifurcation points. 




Figure 1: The three relevant regions, denoted F, O and P, respectively, that 
are depicted by the absolute value of the maximum eigenvalue lAnlj^^^^^ of the 
stability matrix D in (|14|l when plotted as a function of the recovering time Tree 
for different values of the facilitation time rfac- Here, Tfac — 10, 15, 20 and 25 for 
different curves from bottom to top, respectively, in the F and P regions. The 
stationary solutions lack of any local stability for t*^^ < Tree < '''*cc (O)' ^^^ the 
network activity then undergoes oscillations. The arrows signal t*^^ and t**^ for 
Tfac = 10. This graph is for U ^ 0.1 and T = 0.1. 



The resulting situation is summarized in figure ^ for specific values of U, 
T and Tfac,. Eqs. (fT!^ have three solutions, two of which are memory states 
corresponding to the pattern and anti-pattern and the other a so-called para- 
magnetic state that has no overlap with the memory pattern. The stability of 
the two solutions depends on Ticc- The region Ticc > t**^ corresponds to the 
non-retrieval phase, where the paramagnetic solution is stable and the mem- 
ory solutions are unstable. In this phase, the average network behaviour has 
no significant overlap with the stored memory pattern. The region Ticc < t*^c 
corresponds to the memory phase, where the paramagnetic solution is unstable 
and the memory solutions are stable. The network retrieves one of the stored 
memory patterns. For t*^^ < Tj-oc < t**^ (denoted "O" in the figure) none of 
the solutions is stable. The activity of the network in this regime keeps moving 
from one to the other fixed-points neighborhood (the pattern and anti-pattern 
in this simple example). This rapid switching behaviour is typical for dynamical 
synapses and doe s not occur for static synapses. A similar oscillatory behavior 
was reported in ijPantic et al.l l2002t ICortes et al.l l2004J) for the case of only 
synaptic depression. A main novelty is that the inclusion of facilitation impor- 
tantly modifies the phase diagram, as discussed below (figure EJ. On the other 
hand, the phases for Tree < Tr*ee (F) and Tree > '''r*ec (P) correspond, respectively, 
to a locally-stable regime with associative memory (to ^ 0) and to a disordered 
regime without memory (i.e., m = m^ = 0). 

The values t*^^ and t**^ which, as a function of Tfae, U and T, determine the 
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Figure 2: This illustrates how the different regimes of the network activity 
depend on the balance between depression and facilitation. Top graphs: Phase 
diagram (Tree, Tfac) for a — and U — 0.1 at temperature T = 0.1 (left) and 
0.05 (right). The dashed (solid) line is for t*^^ {t*cc) signaling the first-order 
(second-order) phase transitions between the O and F(P) phases. The insets 
show the resulting width of the oscillatory region, S = t**^ — t*^^ , as a function 
of Tfac- Bottom graphs: Phase diagram {t,-cc,U) for a = and T ~ 0.1, and 
7 = Tfac/T,.oc = 1 (left) and 0.25 (right). 



limits of the oscillatory phase correspond to the onset of condition |A„ 



> 1. 



This condition defines lines in the parameter space (ti-oc, Tfac) that are illustrated 
in figure El This reveals that t*^^ (separation between the F and O regions) in 
general decreases with increasing facilitation, which implies a larger oscillatory 
region and consequently a reduction of the memory phase. On the other hand, 
T*g* (separation between O and P regions) in general increases with facilitation, 
thus broadening further the width of the oscillatory phase S = t**^ ~ t*^^. The 
behavior of this quantity under different conditions is illustrated in the insets 
of figure [3 

Another interesting consequence of facilitation are the changes in the phase 
diagram as one varies the facilitation parameter U which measures the fraction 
of neurotransmitter that are not activated by the facilitating mechanism. In 
order to discuss this, we define the ratio between the time scales, 7 = Tfac/Tj-cc, 



and monitor the phase diagram (Tree, U) for varying 7. The result is also in figure 
121 — see the bottom graphs for 7 = 1 (left) and 0.25 (right) which correspond, 
respectively, to a situation in which depression and facilitation occur in the same 
time scale and to a situation in which facilitation is four times faster. The two 
cases exhibit a similar behavior for large U, but they are qualitatively different 
for small U. In the case of faster facilitation, there is a range of U values for which 
r*j,j, increases, in such a way that one passes from the oscillatory to the memory 
phase by slightly increasing U. This means that facilitation tries to drive the 
network activity to one of the attractors (rfac < Tjcc) and, for weak depression 
{U small), the activity will remain there. Decreasing U further has then the 
effect of increasing effectively the system temperature, which destabilizes the 
attractor. This only requires small U because the dynamics {TJ rapidly decreases 
the second term in J-'j to zero. 





Figure 3: For U — T — 0.1 as in figure ^ these graphs illustrate results from 
Monte Carlo simulations (symbols) and mean-field solutions (curves) for the 
case of associative memory under competition of depression and facilitation. 



This shows 



as a function of Tree (horizontal axis) and Tfact (different 



curves as indicated) corresponding to regimes in which the limiting value t*^^ 
decreases (left graph) or increases (right graph) with increasing Tfac, the two 
situations that are discussed in the main text. 



Figureinishows the variation with both Ticc and Tfac of the stationary locally- 
stable solution with associative memory, m ^ Q, computed this time both in the 
mean field approximation and using Monte Carlo simulation. This Monte Carlo 
simulation consists of iterating eqs. (^, Q) and using parallel dynamics. 
This shows a perfect agreement between our mean-field approach above and 
Monte Carlo simulations as long as one is far from the transition, a fact which 
is confirmed below (in figure [SJ. This is because, near t*^^, the simulations 
describe hops between positive and negative m which do not compare well with 
the mean-field absolute value |7tt-| . 

The most interesting behavior is perhaps the one revealed by the phase 
diagram (T, Tfac) in figure 01 Here we depict a case with U — 0.1, in order to 
clearly visualize the effect of facilitation — facilitation has practically no effect 
for any U > 0.5, as shown above — and Trpr. = 3ms in order to compare with 
the situation of only depression in JPantic et al.l l|2002|) . A main result here 
is that, for appropriate values of the working temperature T, one may force 
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Figure 4: Phase diagram (T, Tfac) for U = 0.1 and Tj-cc = Sms. This illustrates 
the potential high adaptability of the network to different tasks, e.g., around 
T = 0.22, by simply varying its degree of facilitation. 



the system to undergo different types of transitions by simply varying Tfac. 
First note, that the line Tfac — corresponds roughly to the case of static 
synapses, since Tree is very small. In this limit the transition between retrieval 
(F) and non-retrieval (P) phases is at T = [/ = 0.1 At low enough T, there is 
transition between the non-retrieval (P) and retrieval phases (F) as facilitation 
is increased. This reveals a positive effect of facilitation on memory at low 
temperature, and suggests improvement of the network storage capacity which 
is usually measured at T = 0, a prediction that we have confirmed in preliminary 
simulations. At intermediate temperatures, e.g., T sa 0.22 for U = 0.1, the 
systems shows no memory in the absence of facilitation, but increasing Tfac one 
may describe consecutive transitions to a retrieval phase (F), to a disordered 
phase (P), and then to an oscillatory phase (O). The latter is associated to a 
new instability induced by a strong depression effect due to the further increase 
of facilitation. At higher T, facilitation may drive the system directly from 
complete disorder to an oscillatory regime. 

In addition to its influence on the onset and width of the oscillatory region, 
Tfac determines the frequency of the oscillations of m. In order to study this 
effect, we computed the average time between consecutive minimum and maxi- 
mum of these oscillations, i.e., a half period. The result is illustrated in the left 
graph of figureEl This shows that the frequency of the oscillations increases with 
the facilitation time. This means that the access of the network activity to the 
attractors is faster with increasing facilitation, though the system then remains 
a shorter time near each attractor due to an stronger depression. On the other 
hand, we also computed the maximum of to during oscillations, namely, [TTilmax- 
This, which is depicted in the right graph of figure also increases with Tfac. 
The overall conclusion is that not only the access to the stored information is 
faster under facilitation but that increasing facilitation will also help to retrieve 




Figure 5: Left graph: Half period of oscillations as a function of Tfac, for Tree = 
10, U = T = Q.l and P = 1, as obtained from the mean-field solution (solid 
curve) and from simulations (symbols). Right graph: For the same conditions 
than in the left graph, this shows the maximum of the absolute value of m 
during oscillations. The simulation results in both graphs correspond to an 
average over 10'^ peaks of the stationary series for m. The fact the statistical 
errors are small confirms a periodic behavior. 



information with less error. 

In order to deepen further on some aspects of the system behavior, we present 
in figures El and H a detailed study of specific time series. The middle graph in 
figure|n|corresponds to a simulation of the system evolution for increasing values 
of Tfac as one describes the horizontal line for T = 0.22 in figure 01 The system 
thus visits consecutively the different regions (separated by vertical lines) as 
time goes on. That is, the simulation starts with the system in the stable 
paramagnetic phase, denoted PI in the figure, and then successively moves by 
varying Tfac into the stable ferromagnetic phase F, into another paramagnetic 
phase, P2, and, finally, into the oscillatory phase O. 

We interpret that the observed behavior in P2 is due to competition between 
the facilitation mechanism, which tries to bring the system to the fixed-point 
attractors, and the depression mechanism, which tends to desestabilize the at- 
tractors. The result is a sort of intermittent behavior in which oscillations and 
convergence to a fixed point alternates, in a way which resembles (but is not) 
chaos. The top graph in figureEl which corresponds to an average over indepen- 
dent runs, illustrates the typical behaviour of the system in these simulations; 
the middle run depicts an individual run. 

Further interesting behavior is shown in the bottom graph of figure El This 
corresponds to an individual run in the presence of a very small and irregular 
external stimulus which is represented by the (green) line around m — 0. This 
consist of an irregular series of positive and negative pulses of intensity ±0.03^^ 
and duration of 20 ms. In addition to a great sensibility to weak inputs from 
the environment, this reveals that increasing facilitation tends to significantly 
enhance the system response. 

Figure |7| shows the power spectra of typical time series such as the ones in 
figure El namely, describing the horizontal line for T = 0.22 in figure 0] to visit 
the different regimes. We plot here time series m (t) obtained, respectively, for 
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Figure 6: Time series for the overlap function, m, at T — 0.22 (horizontal 
dotted line in figure 0)) as one increases the value of Tfac in order to visit the 
different regimes (separated here by vertical lines). The simulations started with 
Tfac = 1 at i = 1 and Tfac was then increased by 10 units every 200 ms. The 
bottom graph corresponds to a case in which the system is under the action of 
an external stimulus (as described in the main text). The middle graph depicts 
an individual run when the system is without any stimulus, and the top graph 
corresponds to the average of \m\ over 100 independent runs of the unperturbed 
system. 



Tfac — 2, 20, 50 and 100 and, on top of each of them, the corresponding spectra. 
This reveals a flat, white-noise spectra for the PI phase and also for the stable 
fixed-point solution in the F regime. However, the case for the intermittent P2 
phase depicts a small peak around 65 Hz. The peak is much sharper and it 
occurs at 70 Hz in the oscillatory case. 

4 Conclusion 

We have shown that the dynamical properties of synapses have profound conse- 
quences on the behaviour, and the possible functional role, of recurrent neural 
networks. Depending on the relative strength of the depression, the facilita- 
tion and the noise in the network, one observes attractor dynamics to one of 
the stored patterns, non-retrieval where the neurons fire largely at random in a 
fashion that is uncorrelated to the stored memory patterns, or switching where 
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Figure 7: Spectral analysis of the cases in figure IHl On top of each of the small 
panels, which show typical time series for Tfac = 2, 20, 50 and 100, respec- 
tively, from top to bottom and from left to right, the square panels show the 
corresponding power spectra. Details of the simulations as in figure El 



none of the stored patterns is stable and the network switches rapidly between 
(the neighborhoods of) all of them. These three behaviours were also observed 
in our previous work where we studied the role of depression. 

The particular role of facilitation is the following. The transitions between 
these possible phases are controlled by two facilitation parameters, namely, Tfac 
and U. Analysis of the oscillatory phase reveals that the frequency of the oscil- 
lations, as well as the maximum retrieval during oscillations increase when the 
degree of facilitation increases. That is, facilitation favours in the model a faster 
access to the stored information with a noticeably smaller error. This suggests 
that synaptic facilitation might have an important role in short-term memory 
processes. 

There is increasing evidence in the literature that similar jumping processes 
could be at the origin of the animals ability to adapt and rapidly response to the 
continuously changing stimuli in their environment. We therefore believe that 
the network behaviour that is the consequence of dynamic synapses as presented 
in this paper may have important functional implications. 
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